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METHOD FOR ESTIMATING RESONANCE FREQUENCIES 



Field of the invention 



10 [0001] 



The present invention is related to an 



analysis technique for recorded speech signals that can be 
used in various fields of speech processing technology. 

State of the art 



source-filter speech model is very frequently used. It 
mainly assumes that the speech signal is produced by 
exciting a filter (corresponding to vocal tract), i.e. by 
an excitation produced by the lung pressure and larynx 

20 (source signal or the glottal flow signal) . 

[0003] Decomposition of the two systems (the source 

and the filter (or the vocal tract) ) has been an 
interesting problem in all areas of speech pr9cessing. The 
source and the filter characteristics provide veary useful 

25 information for speech applications. In many applications, 
removing one system' s effect on the other improves the 
quality of analysis performed by the application. For 
example, in speech synthesis, source signal characteristics 
estimation is very important for voice quality analysis of 

30 speech, database labelling (for voice quality and prosodic 
events) , speech quality modification (emotional speech 
synthesis) . Both systems (the source and the tract) show 
some resonance characteristics, which are considered to be 
their essential features. These resonances are called the 



15 [0002] 



In all fields of speech processing, the basic 
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formants and their estimation has been studied by various 
researchers, especially for the filter part. However, 
estimation of the spectral resonance of the source (called 
the glottal formant) as presented in the present 

5 application is rather a new concept. 

[0004] In a more theoretical framework, resonances 

of speech signals are modelled with poles in the z-domain. 
Linear predictive (LP) analysis is the most frequently used 
technique for estimating signal resonances by pole 

.0 estimation. Based on an all -pole model, LP analysis 
estimates poles of a system, which correspond to resonances 
of a signal. Once the resonances are estimated with LP 
analysis, the problem is reduced to relating source and 
tract resonances respectively, a difficult and important 

.5 problem in speech processing technology. There are many 
difficulties and inefficiencies of LP estimation due to 
various problems like non- linear source -tract interaction, 
dependency on degree of linear prediction and separating 
source resonances from vocal tract . 

0 [0005] Despite the disadvantages of LP analysis, 

various methods have been proposed for source -tract 
separation using LP analysis. One of the well-known 
algorithms is the Pitch Synchronous Iterative Adaptive 
Inverse Filtering (PSIAIF) (see 'Glottal Wav^e Analysis with 

5 PSIAIF', Alku, Speech Communication, v^ol.ll, pp. 109-117, 
1992) , which tries to perform the separation by an 
iterative linear prediction analysis. There also exist 
methods based on the linear prediction analysis together 
with glottal flow models. All of these techniques suffer 

0 from the deficiencies of the LP approach because LP 
estimation is hard-coded in these techniques. 
[0006] Current state of art based on LP 

autocorrelation analysis is capable of detecting speech 
signal resonances but incapable of detecting ant i- causal 
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and causal resonances respectively, which proves to be a 
major drawback. 

1^007] The two approaches closest to the methodology 

adopted in the present invention, are those of Rabiner 
5 {'System for automatic formant analysis of voiced speech', 
Rabiner and Schafer, JASA, vol.47, no. 2/2, pp. 634-648, 
1970) and Hurt hy and Yegnanarayana ('Formant extraction 
from group delay function', Speech Communication, vol.10, 
no. 3, pp. 209-221, August 1991). Both methodologies are 
10 based on spectral processing of speech. Rabiner' s approach 
is based on analysis of the Z-transform amplitude spectrum 
and Murthy's on the minimum phase group delay function 
derived from amplitude spectrum. In both cases one of the 
most important method steps is the cepstral smoothing-: 

15 

Aims of the invention 

[0008] The present invention aims to provide a 

method for estimating the formant frequencies for vocal 
tract and glottal flow, directly from speech signals. The 
20 invention further aims to provide a computer program that 
implements such a method. 



Summary of the invention 

[0009] The present invention relates to a method for 

25 estimating from an input signal the resonance frequencies 
of a system modelled as a source and a filter, comprising 
the steps of 

- determining the Z-transform of the input signal, 

- calculating the differential -phase spectrum of the Z- 
30 transformed input signal (without using the amplitude 

spectrum) , whereby the Z-transform is evaluated on a 
circle centered around the origin of the Z-plane, 

- detecting the peaks on the differential -phase spectrum, 
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- attributing the peaks to either the source or the 
filter, 

- estimating the resonance frequencies from the peaks. 
[0010] In a preferred embodiment the circle on which 

5 the Z-transform is evaluated, is different from the unit 
circle in the Z-plane. Advantageously, the Z-transform of 
the input signal is evaluated on more than one circle. 
[0011] In another embodiment the input signal is 

windowed . 

10 [0012] Typically the input signal is a speech 

signal . 

[0013] Preferably the source is a glottal flow 

signal and the filter is a vocal tract system. 

[0014] In an advantageous embodiment the step of 

15 attributing the peaks is performed based on the sign of 
said peaks. Said step of attributing is preferably further 
based on the radius of said circle. 

[0015] In an alternative embodiment the method for 

estimating the resonance frequencies further comprises the 
20 step of removing zeros of the input signal's Z-transform 
before performing the step of calculating the differential - 
phase spectrum. 

[0016] In a second object the invention also relates 

to a program, executable on a programmable device 
25 containing instructions, which, when executed, perform the 
method as described above. 

Short description of the drawings 

[0017] Fig. 1 represents the source-filter speech 

30 model. 

[0018] Fig. 2 shows the anti-causal character of the 

glottal flow signal- a) a causal filter response, b)an anti- 
causal filter response, c)a typical glottal flow signal. 
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[0019] Fig. 3 represents a causal and an anti-causal 

single pole filter response plots: a/^causal impulse 
response, Jbj log -amplitude spectrum of a), c^group delay 
spectrum of a) , djanti- causal impulse response, ejlog- 
5 amplitude spectrum of d) , fjgroup delay spectrum of d) . 

[0020] Fig. 4 represents a mixed phase all-pole 

signal with causal resonances at 1000 Hz and 2000 Hz and 
anti-causal resonances at 500 Hz and 1500 Hz. ajtime domain 
signal, Jbj log -amplitude spectrum, c^group delay spectrum, 
10 djpoles on z-plane-cartesian coordinates, e)poles on z- 
plane-polar coordinates. 

[0021] Fig. 5 shows the effect of zeros on the group 

delay function, a) Zeros of Z-Transform (ZZT) plotted in 
polar coordinates (region of zeros close to the unit; circle 
15 indicated by dashed lines) , b) group delay function- with 
ZZT close to unit circle superimposed. 

[00221- Fig. 6 represents an example of differential- 

phase spectrum analysis of synthetic speech. 
[0023] Fig. 7 represents a flowchart of the method 

20 according to the invention. 

Detailed description of the invention 

[0024] The invention targets the estimation of 

resonance frequencies (formant frequencies) of the source 
25 and the vocal tract contributions directly from the speech 
signal itself . 

[0025] As will be shown, the source-tract separation 

problem needs to be handled with tools, which can detect 
anti-causal resonances. The technique according to the 
30 invention is more effective than current state of art 
methods, mainly because it is capable of detecting causal 
and anti-casual resonances without utilisation of a 
particular model of analysis, but only with spectral peaJc 
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analysis. Additionally, the technique has no dependency on 
analysis degrees as in LP analysis systems. 



[0026] The source-filter model (see Fig.l) is 

5 usually accompanied by the assumption that a speech signal 
is a physical system output and therefore it is the output 
of a stable filter system. In a stable causal linear time 
invariant system, all the resonances of the signal shall 
correspond to poles inside the unit circle in z-plane. Once 

10 it is also assumed that the system is all-pole (i.e., the 
system can be defined by only poles and a gain factor) , one 
ends up with a minimum* phase system (the systems having all 
zeros and poles inside the unit circle are classified as 
minimum phase systems) , Speech signals have been assumed to 

15 be minimum-phase signals for long years in many studies. 

[0027] Here a mixed-phase speech model is applied, 

where some signal resonances correspond to poles outside 
the unit-circle but these poles are anti-causal, therefore 
still stable. These ant i -causal poles correspond to 

20 resonances of the glottal source signal and causal -stable 
poles (inside the unit circle) correspond to the vocal 
tract resonances. 

[0028] A signal x(n) is said to be causal if x(n)=0 

for all negative values of n. By reversal of x(n) in time 

25 domain, an anti -causal signal x(-n) is obtained. The 
version of x(-n) time shifted to positive time indexes is 
also referred to as anti-causal, because the filter 
characteristics are time -reversed. Shifting the signal in 
time only introduces a linear phase component to the signal 

30 (a DC component is added to the group delay spectrum) and 
the amplitude spectrum is unaffected. 

[0029] The anti -causality assumption for the source 

is based on the characteristics of glottal flow models (as 
explained in detail in ^Spectral correlates of glottal 
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waveform models: an analytic study', Doval and 
d'Alessandro, Proc, ICASSP 97, Munich, pp^ 446-452) . One 
easy explanation is through visual inspection of signal 
waveforms. In Fig. 2 an example glottal flow signal is 
5 presented together with a causal and an ant i- causal filter 
response. The glottal flow signal has the same 
characteristics as the anti -causal r-esponse, namely a 
slowly increasing function with a rather sharper decay. The 
glottal flow signals can be modelled by an all -pole system 
10 where the, poles are anti-causal. For stability of an anti- 
causal all-pole system, all of the poles have to be out of 
the unit circle and therefore the system is maximum phase. 
[0030] The mixed-phase model assumes speech signals 

have two types of resonances: anti-causal resonances;-. of the 
15 source (glottal flow) signal and causal resonances of the 
vocal tract filter. The invention aims to estimate these 
resonances from the speech signal. The estimation method is 
based on analysis of ^differential-phase spectra'. 
[0031] The closest concept to differential-phase 

20 spectra is the group delay, so the differential -phase 
spectra will be introduced as a more general form of group 
delay. The source- tract separation is based on spectral 
analysis of causal and anti-causal parts of the speech 
signal. For such a target, the frequently used amplitude 
25 (or power) spectra offer very little help (if any) . Rather 
the phase spectra have to be studied, since causality can 
only be observed in phase spectra. One of the main 
difficulties of phase analysis is its automatically wrapped 
nature. The phase spectra derivative however does not have 
30 the same property and various other advantages exist over 
both phase spectra and amplitude spectra. The group delay 
function GD(0) is defined as the negative of derivative of 
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the argument 0((f>) of X((t>), being the discrete Fourier 
transform of a signal x(n) . 

X(e'^) = DFT{x{n)) = a{(p) + jb{(p) (equation 1 ) 

3{(p) = arctanC-^) (equation 2) 

a{(p) 

5 GD{(p) = ^i^^^ (equation 3) 

dip 

The causality feature of a resonance is best observed on 
group delay spectra since a reversal of a signal in the 
time domain corresponds to no change in power spectrum of 
the signal but the group delay spectrum is inverted 

10 horizontally. In Fig. 3 the effects of time reversal on the 
amplitude spectrum and group delay function are presented 
on an example. The signal in Fig. 3a is time reversed to 
obtain the signal in Fig. 3d. Comparison of Fig. 3b with 
Fig. 3e and Fig. 3c with Fig. 3f shows that the only change 

15 in frequency characteristics is horizontal inversion of the 
group delay function. 

[0032] In Fig. 4 a mixed phase signal (synthesised 

with all -pole model) and its group delay spectrum are 
presented. The mixed phase signal in Fig. 4 is synthesised 

20 by convolving a causal filter response with resonances at 
1000 Hz and 2000 Hz and anti-causal filter response with 
resonances at 500 Hz and 1500 Hz. The causal and anti- 
causal resonances appear as peaks with opposite direction 
on the group delay spectrum where on the amplitude spectrum 

25 causality or anti-causality cannot be observed. Therefore, 
for analysis of causality of resonances of mixed-phase 
signals like speech, group delay function processing 
(obtained from phase information) is advantageous to 
amplitude spectrum processing. 

30 [0033] However, observation of these opposite 

direction peaks on group delay spectra for real speech 
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signals is not easy due to existence of roots (zeros) of 
the z-transform located very closely to the unit circle on 
the z-plane. Each zero causes a spike in the group delay 
function masking important details of group delay function 
5 in that particular frequency region. The literal 
explanation is as follows : the Discrete Fourier Transform 
(DFT) of a signal can be expressed as 



10 sequence x(n), the Zjn represent the roots of the z- 
transform and G is the gain factor. Each factor in (eq.4) 
corresponds, in the z-plane, to a vector starting at, Z^, and 
ending at e^*. Hence, where e^* gets very close to one of 
these zeros, one of the factors in (eq.4) gets very small 

15 in amplitude, and undergoes an important argument 
modification which corresponds to spiky change in the group 
delay function. So, a simple observation on group delay 
spectrums does not provide the desired information, the 
plots are usually too noisy due to the zeros close to unit 

20 circle. In Fig. 5b, a group delay function for a speech 
frame is presented together with zeros of z-transform of 
the same signal closely located to the unit circle. Each 
zero creates a spike in the group delay function hiding 
resonance peaks to appear as in Fig. 4. 

25 10034] In the solution according to the invention, 

the problem is first redefined in a more general framework 
of 'differential-phase spectrum' . The differential-phase 
spectrum is defined as the negative derivative of the phase 
spectrum calculated from the signal's z-transform, 

30 evaluated on a circle with any radius centered at the 
origin of the z-plane. This definition makes the group 
delay function a special case of differential -phase 




(equation 4) 



where XleP"^) denotes the z-transform of a discrete time 
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spectrum, where the radius of the circle is r=l. Changing 
the radius from r=l to other values yields a new circle in 
a region where zeros do not exist. By calculating 
differential-phase spectra at this new circle, the spiky 
5 effects of the zeros can be avoided and resonance peaks can 
be tracked. The invention advantageously makes use of the 
insight that signal resonances can be tracked from 
differential phase spectra calculated on circles with 
radius different from 1 (the unit circle), i.e. on circles 

10 with a radius either larger or smaller than 1. The analysis 
of more than one differential -phase spectrum is 
advantageous for the estimation of source and tract 
characteristics due to the poles existing inside and 
outside the unit circle (though a single differential -phase 

15 spectrum can also reveal all causal and anti -causal 
resonances) . Therefore the method preferably includes the 
step of processing more than one differential -phase 
spectrum calculated at circles with different radius, as 
this yields an improved robustness. 

20 [0035] The resulting differential-phase spectra are 

much less noisy than group delay functions, but still zeros 
may exist anywhere in the z-plane. A single unexpected zero 
causes the same type of spiky effect for the frequency 
regions, where the zero is close to the analysis circle. In 

25 order to get rid of this effect, a zero-removal technique 
is proposed that effectively calculates noise-free 
differential -phase spectra. The procedure comprises the 
steps of: 

• estimating zeros (roots of z- transform polynomial 
30 of the speech signal) with a numerical method, 

• removing or displacing zeros from z-plane 
regions, where the differential -phase spectrum is to be 
calculated, and 
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• calculating the differential-phase spectrum at 
this region from the remaining zeros. 

[0036] The roots (zeros) of a z-transform polynomial 

can be determined by a numerical method. The obtained set 
5 of roots of 2-transform polynomial can be divided into two 
sets of roots (which corresponds to dividing the z- 
transform polynomial into two polynomials) . The obtained 
two sets of roots correspond to the spectral representation 
of glottal flow and vocal tract contributions of speech 

10 signal : when classifying the roots according to their 
distance to the origin of the z-plane (i.e. their radius), 
roots outside the unit circle are classified as glottal 
flow roots and roots inside the unit circle as vocai tract 
roots. For estimation of the characteristics of one of the 

15 systems, it is preferred to remove the set roots- 
corresponding to the other system and then perform 
analysis. For example, for estimation of vocal tract 
characteristics, glottal flow roots which are out of the 
unit circle, are removed from the complete set of zeros and* 

20 then the differential -phase spectrum calculation is 
performed . 

[0037] By additionally applying this zero-removal 

method, no zeroes close to analysis circle will be /left and 
the differential -phase spectrum obtained will not include 

25 zero spikes. 

[003 8] An example on synthetic speech analysis is 

presented in Fig. 6 for the zero-removal technique and its 
effect to differential -phase spectrum. The first row of 
plots include the actual amplitude spectrum of glottal flow 

30 (Fig. 6a) and the amplitude spectrum vocal tract (Fig. 6b) 
used in synthesis. The aim is to estimate the resonance 
peak (formant) locations of these two systems directly from 
the speech signal, which is constructed by convolution of 
these two systems and an impulse train to obtain several 
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cycles of speech signal. An all-pole vocal tract filter (of 
a typical vowel ^^a'' with normalised resonance frequencies 
at 0.075, 0.15, 0.275, 0.4 for IGOOO Hz) is used for 
synthesis. This synthetic speech signal is windowed for 
5 analysis. Estimation of formant frequencies by peak picking 
on differential -phase analysis at two circles are aimed: 
r=0.95 and r=1.05. The ZZT of windowed speech signal is 
presented in Fig. 6c and Fig. 6d with the analysis circles 
indicated on top. The differential -phase spectra obtained 

10 on the indicated analysis circles are presented in Fig, 6e 
and Fig. 6f respectively. Since zeros close to analysis 
circles exist, the resulting differential -phase spectra are 
noisy. To get rid of this effect, zeros close to the 
analysis circle are removed (as plotted in Fig. 6g and Fig. 

15 6h) and differential-phase spectra are re-calculated. The 
resulting differential -phase spectra are presented in Fig. 
6i and Fig. 6j . Peak picking is performed on these spectra 
and sign and frequencies of the peaks are stored. The 
negative peak in Fig. 6i will be classified as glottal 

20 formant peak and the positive peaks on Fig. 6j will be 
classified as vocal tract formant peaks in the final 
decision. 

[0039] Finally, Fig. 7 summarises the method 

according to the invention in a flowchart. The various 
25 steps are as described previously. 



